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C^l ! Abstract 

, ^ . Distributed consensus processing over random graphs and with randomized node dy- 



namics is considered. At each time step k, every node independently updates its state with 
a weighted average of its neighbors' states or stick with its current state. The choice is a 
Bernoulli trial with success probability P^. The random graph processes, defining the time- 
. varying neighbor sets, are specified over the set of all possible graphs with the given node 

^ ■ set. Connectivity-independent and arc-independent graph processes are introduced to cap- 

ture the fundamental influence of random graphs on the consensus convergence. Necessary 
\ and sufficient conditions are presented on the success probability sequence {Pk} for the net- 

■ work to reach a global almost sure consensus. For connectivity-independent graphs, we show 
^f) • that P^ = cx) is a sufficient condition for almost sure consensus, where n is the number 

of nodes. For arc-independent graphs, we show that = oo is a sharp threshold, i.e., the 

consensus probability is zero for almost all initial conditions when the sum converges, while 
it is one for all initial conditions when the sum diverges. Convergence rates are established 
by lower and upper bounds of the e-computation time. The results add to the understanding 

■ of the interplay between random graphs, random computations, and convergence probability 
I for distributed information processing. 
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1 Introduction 



In recent years, there has been considerable research interest on distributed algorithms for infor- 
mation exchange, estimation, and computation over networks. Such algorithms have a variety 
of potential applications in sensor networks, peer-to-peer networks, wireless networks and net- 
worked control systems. Targeting the design of simple decentralized algorithms for computation 
or estimation, where each node exchanges information only with neighbors, distributed averag- 
ing serves as a primitive towards more sophisticated information processing algorithms, e.g.. 

The investigation of the consensus problem has a long history, which can be traced back to 
1950s on the study of ergodicity of non-homogeneous Markov chains described as the product of 
stochastic matrices jl6U15j . The computation of such products have a natural distributed struc- 
ture, and was used to model consensus, or distributed averaging, algorithms in computer science 
[IHIIIS], engineering [201 [2H], ^-^id social science [T71 SSI E] • Deterministic consensus algorithms 
have been extensively studied for both time-invariant and time-varying communication graphs 
in the literature, with efforts typically devoted to finding proper connectivity conditions that 
can ensure a desired collective convergence [221 [201 ESI 123 EZ] . Iii addition, researchers were also 
interested in the design of weighted averaging algorithms to reach a faster consensus, or reach a 
consensus with asynchronous computations [13l [12l [371 ESI [H] • 

The underlying communication graph over which the consensus algorithm is carried out may 
be random. The Erdos-Renyi graph, usually denoted as G{n,p), is a classical model, in which 
each edge exists randomly, and independently of other edges with probability p E (0, 1] over a 
network with n nodes. In [30], the authors studied linear consensus dynamics with communi- 
cation graphs defined as a sequence of independent, identically distributed (i.i.d.) Erdos-Renyi 
random graphs, and almost sure convergence was shown. Then in [31], the analysis was gen- 
eralized to directed Erdos-Renyi graphs. Mean-square performance for consensus algorithms 
over i.i.d. random graphs was studied in [33], and the influence of random packet drop was 
investigated in [3l]. In [23], a necessary and sufficient condition was presented on almost sure 
asymptotic consensus for independent random graphs. In [IQ], the authors studied distributed 
average consensus in sensor networks with quantized data and random link failures. The inde- 
pendence of the switching communication graphs may then not hold. In [36], the communication 
graph was described as a finite-state Markov chain where each graph corresponds to one state 
of the chain, and almost sure consensus was concluded by investigating the connectivity of the 
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closed positive recurrent sets of the Markovian random graph. In [39], convergence to consensus 
was studied under more general linear consensus algorithms, where the random update and con- 
trol matrices were determined by possibly non-stationary stochastic matrix processes coupled 
with disturbances. 

Classical random graph theory suggests that many important properties of graphs appear 
suddenly from a probabilistic point of view [7]. To be precise, there is usually a function, called 
a threshold, of a certain parameter, such that almost every graph has a given property if this pa- 
rameter grows faster than the function. Otherwise almost every graph fails to have the property. 
Examples of properties considered in the literature include connectivity, /c-connectivity, and the 
Hamiltonian property. The phenomenon is called a zero-one law. It has been shown that Inn/n 
is such a threshold function for the connectivity of Q(n,p) in the classical work by Erdos and 
Renyi [8]. Similar threshold functions were shown for random geometric graphs nodes randomly 
distributed in a unit square and their connections determined by distances [21 [TO]. In [llj . a 
threshold function was established on the ^-connectivity of random graphs defined by a nearest 
neighbor rule. 

Naturally, one may wonder, would there be any threshold condition which leads to a similar 
zero-one law with respect to collective convergence of consensus dynamics over random graphs? 
Although various results have been established to guarantee probabilistic consensus [30\ [3T| [33l 

[55] , the literature still lacks a model and analysis for consensus dynamics over random graphs 
which can accurately describe the fundamental influence of graph processes and whether such a 
zero-one law could arise. 

To this end, in this paper, we study a randomized consensus algorithm over random graphs. 
At each time step k, every node independently updates its state with a weighted average of 
its neighbors' states or stick with its current state. The choice is a Bernoulli trial with success 
probability Pk- The random graph processes are modeled as a sequence of random variables 
which take value from the set of all possible graphs with the given node set. We introduce 
connectivity-independence and arc-independence for the considered random graph processes. 
For connectivity-independent graphs, we show that Pk~^ = oo is a sufficient condition for 
almost sure consensus, where n is the number of nodes. For arc-independent graphs, we show 
that ^i^Pk = oo is a sharp threshold, i.e., the consensus probability is zero for almost all 
initial conditions when the sum converges, while it is one for all initial conditions when the sum 
diverges. In other words, a zero-one law is established for the presented randomized consensus 
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processing over arc-independent graphs, and we see that the success probabihty of the node 
updates defines the parameter for the corresponding threshold function. Hence, also consensus 
computations over random graph processes show the sudden transition similar to Erdos-Renyi 
graphs, and other models in the literature. 

1.1 Problem Definition 

Consider a network with node set V = {1,2, ... ,n}. A directed graph (digraph), Q = {V,£) 
consists of a node set V and an arc set £, where each element e = (i, j) € £^ is an ordered pair of 
two different nodes i and j in V. [3]. There are 2^^^~^^ different digraphs with node set V. We 
label these graphs from 1 to 2"^"^^) by an arbitrary order. In the following, we will identify an 
integer in ^7 = {1, . . . , 2"^"^^^} with the corresponding graph in this order. So 0, represents the 
graph set. 

We model the node interactions as the following graph process. 

Definition 1 (Graph Process) The graph process over time is a sequence of random variables 
that take value in i}, denoted by Gki^) = (V, k = 0,1, . . . . 

When there is no possibility for confusion, we write Qk{^) as Q^. We call node j a neighbor 
of i at time k if there is an arc from j to i in Qi^.. Each node is supposed to always be a neighbor 
of itself. Denote the random set Ni{k) = {j € V : (j, i) G f^} U {i} as the neighbor set of node i 
at time k. Let {-Pfc}o° be a given deterministic sequence with < < 1 for all k. Independent 
of the graph process, node states, and other nodes, the updating rule of node i is as follows: 



Xi{k + 1) 



I]jGM(fc) with probability Pfc 



Xi{k), with probability 1 — Pk 

where aij{k) denotes the weight of arc We use the following weights rule as our standing 

assumption, cf., [22| [26l [271 Ii2] . 

Assumption (Weights Rule) There exists a constant rj > such that 

(i) ^ CLij{k) = 1 for all i and k; 

(ii) aij{k) > T] for all i, j and k. 
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Remark 1 The randomized information processing (OP describes the possible unwillingness or 
inability of a node to update, even if it received information from other nodes. For instance, 
in the opinion dynamics of social networks, forceful belief exchanges may happen randomly by 
Bernoulli decisions for individuals so that misinformation may be spread 14 3f . From an engi- 
neering viewpoint, in wireless communication nodes may be asleep or broken randomly due to 
the unpredictability of the environment and the unreliability of the networked communication 

Our interest is in the convergence of the randomized gossip consensus algorithm and the 
time it takes for the network to reach a consensus. Let 

x{k;x^) = {xi{k; xiiO))... xn{k; XniO)) f eM,"" 

be the random sequence driven by the randomized algorithm ([1]) for initial condition x^ = 
(xi(0) . . . x„(0))"^. When it is clear from the context, we will identify x{k; x^) with x{k). Denote 

H{k) = max Xi{k), h{k) = min Xi{k) 

i=l,...,n i=l,...,n 

as the maximal and minimal states among all nodes, respectively, and define T-L{k) = H{k) — h{k) 
as a consensus measure. We introduce the following definition. 

Definition 2 Global almost sure (a.s.) consensus is achieved for ([TJ) if 



P lim nik) =0=1 (2) 

V fc— >-oo / 

for all G R". Moreover, for any < e < 1, the e-computation time is 

T^„M = j^M{k: P(|g >.)<.}. (3) 

1.2 Main Results 

We first present a conclusion on the impossibility of consensus. 

Theorem 1 Global a.s. consensus cannot be achieved for (CP ifYl'k'=o^k < oo. In fact, a lower 
bound for Tcomi^) is given by 



1=0 



rcom(e) > sup[k : J^log(l - P,)"' < 



5 



Note that, Theorem [T] holds for all possible random graph processes. If we add a simple 
self-confidence assumption, this impossibility claim can be improved as follows. 

Theorem 2 Suppose there exists a constant a^, such that aii{k) > a* > 1/2 for all i and k. 
Then 

P( lim nik) = o) = (4) 

for almost all initial conditions if'Yl/k=o^k < co- 

Recall that a digraph Q is said to be quasi- strongly connected if Q has a root [Ij. We introduce 
the following definition. 

Definition 3 Let {^/j}^ he a random graph process. Then {Qi^^^ is connectivity-independent 
if the events = is quasi- strongly connected^, A; = 0, 1, ... , are independent. 

For connectivity-independent graphs, the following conclusion holds. 

Theorem 3 Suppose {Qk}'^' is connectivity-independent and there exists a constant < q < 1 
such that P{Qk is quasi- strongly connected) > q for all k. Assume in addition that Pfc+i < Pk- 
Then global a.s. consensus is achieved for ^ ifY1^0'^k~^ ~ Moreover, an upper bound for 
(e) is given by 

rcom(6)<inf{M: J]log(l-l™^ >loge-2}x(n-l)2. 

i=0 

We believe that the convergence condition given in Theorem [3] is quite tight since the prob- 
ability that all the arcs in Algorithm ([1]) are active at time k is PJ}, while one single inactive 
arc is enough to break the connectivity of the graph. Nevertheless, connectivity is a global prop- 
erty of a graph, and indeed it does not rely on any specific arc. The next definition is on the 
independence of the existence of the arcs in the graph process. 

Definition 4 Let {Qj.}"^ be a random graph process. Suppose Q* = (y,£*) is a given determin- 
istic graph. Then {Qk}'^' is arc-independent with respect to Q* if the events ^k,T = {(v^jV) € 
^fcji {iTjjr) G £*, A; = 0, 1, ... , are independent. We call Q* a basic graph of the random graph 
process. 

For arc-independent graphs, we have the following result. 



6 



Theorem 4 Suppose {Qj^^'^' is arc-independent with respect to a quasi- strongly connected graph 
Q* = (y,E*), and there exists a constant < < 1 such that P((z, j) G £k) > Oq for all k and 
{i,j) € £* . Then ^^ achieves global a.s. consensus if and only if Yl'k'=Q = oo. Moreover, we 
have 

T,oUe) < inf {fc : ^ (1 - (1 - P,)") > lliziMl log {Ae^n)} (5) 

where A = I — (^)^" ^^'^ ' and \£*\ represents the number of elements in £* . 

The convergence conditions on the success probabiUty sequence {Pk} given in Theorems [3] 
and m are similar to the convergence conditions in stochastic optimization, recursive algorithms, 
adaptive control etc. For example, they are consistent with the decreasing gain condition in the 
study of stochastic approximation, to guarantee almost sure convergence of adaptive algorithms 
[6]. Theorems [2] and m combined suggest that XI^^q Pk = oo is a sharp threshold for ([1]) to reach 
a.s. consensus under the assumption of arc-independent graphs and self-confident updates: the 
consensus probability is zero for almost all initial conditions when the sum converges, while it 
is one for all initial conditions when the sum diverges. 

1.3 Paper Organization 

The rest of the paper is organized as follows. In Section 2, we prove the results on the impossibil- 
ities of consensus convergence of Theorems [1] and [2j Section 3 presents convergence analysis for 
connectivity-independent graphs. In fact, we study some generalized cases which only rely on the 
independence and connectivity of joint graphs on different time intervals. The concept of joint 
connectivity has been widely studied in the literature for deterministic consensus algorithms 
[2T| [22l [29l [26l [27] . We investigate directed, bidirectional and acyclic graphs and convergence 
conditions are given in each case. The proof of Theorem[3]is obtained as a special case. In Section 
4, we turn to arc-independent graphs. The proof of Theorem [His carried out using a stochastic 
matrix argument. Finally some concluding remarks are given in Section 5. 

2 Impossibilities for Consensus Convergence 

This section focuses on the proof of Theorems [T] and [2l The following lemma is well-known. 
Lemma 1 Suppose < 6^ < 1 for all k. Then Ylk^=Qbk = oo if and only ifYl'kLoi^ ~ ^k) = 0. 
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2.1 Proof of Theorem [H 

From Algorithm ([1]), if X^^g-^fc < oo, we have 

oo 

P(^xi{k + 1) = x^{k), A; = 0, 1, . . . ) > J](l - Pfc) = ro, 

fc=0 

where < ro < 1 according to Lemma [TJ Then it is straightforward to see that the impossibility 
claim of Theorem [1] holds. 

Next, we define a scalar random variable w{k) = l-i{k + 1) /T-L{k) when ^{{k) > 0, and 
w{k) = 1 when l-i[k) = 0. Obviously, h[k) is non-decreasing, and H{k) is non-increasing. Thus, 
it always holds that w^k) < 1. We see from the considered algorithm that 

p[zu{k) = i)>{i-Pkr. (6) 

As a result, we obtain 

P(|||>6) >p(t^(i) = l, j = 0,...,A;-l) >n(l-P,r, (7) 

and then the lower bound for the e-computation given in Theorem [1] can be easily obtained. The 
proof of Theorem [1] is completed. 

2.2 Proof of Theorem [2 

In order to prove Theorem [21 we need the following lemma. 

Lemma 2 Suppose there exists a constant a* such that au^k) > a* > 1/2 for all i and k. Then 
for all k > 0, we have 

n{k + l) > (2a, - l)n{k). 
Proof. Suppose Xm{k) = h{k) for some m G V. Then we have 

{k)xm{k)+ ^ amj{k)xj{k) 

< amm{k)h{k) + (1 {k))H{k) 

< a^h{k) + (l - a^)H{k), 

which implies 

h{k + l) <a^h{k) + {l-a^)H{k). (8) 
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A symmetric argument leads to 

H{k + l)>{l-a^)h{k) + a^H{k). (9) 
Based on ([8]) and ([9]), we obtain 

n{k + l) = H{k + l) - h{k + l) 

> (1 - a^)h{k) + a^H{k) - [a^h{k) + (l - a^)H{k)\ 

> (2a* - l)n{k). (10) 

The desired conclusion follows. □ 
Noting the fact that Lemma [2] holds for all graphs, we see that 



P(2a* - 1 < ct(A;) < 1, /c > 0) = 1 (11) 

and 

p(^w{k) < 1^ < P(^at least one node takes averaging at time kj 

= i-{i-Pkr (12) 

where w{k) was defined in the proof of Theorem [TJ 
Next, by Lemma [H it is not hard to establish 

oo oo 
J2Pk <00 ^ n(l-Pfc) >0 

k=0 k=0 

oo 

^ l[{i-Pkr>o 

k=0 

oo 

^ J](l-(1-Pfc)") <oo, (13) 

k=0 

where the last equivalence is obtained by taking 6^, = 1 — (1 — P^)" in Lemma [TJ 

Therefore, if X^^g-^^ ^ ^PP^yi^S First Borel-Cantelli Lemma [5] on (fT2|) . it follows 
immediately that 



Pyw{k) < 1 for infinitely many kj = 0. (14) 

Furthermore, noticing that (jlip implies consensus can only be achieved via infinite time steps, 
we eventually have 

P(^^lim n{k) = for •H(O) > o) < p(^ct(/c) < 1 for infinitely many k^ = 0. (15) 
Since {x(0) : 'H(O) = 0} has zero measure in R", Theorem [2] follows and this ends the proof. 



3 Connectivity-independent Graphs 



In this section, we present the convergence analysis for connectivity-independent graphs. We are 
going to study some general cases relying on the joint graphs only. 

Joint connectivity has been widely studied in the literature on consensus seeking |2H I22j . 
The joint graph of Qk on time interval [ki, ^2] for < /ci < ^2 ^ co is denoted by Q{[ki, ^2]) = 
(^) Ua:6[A;i fc2] ■ introduce the following definition of joint connectivity for the random 
graph process. 

Definition 5 Let {Gk}'o' o random graph process. 

(i) We call {^^j^ stochastically uniformly quasi- strongly connected, if there exist two constants 
B > 1 and < q < I such that \^Q(^[mB, (m + 1)B — l])}^ is connectivity-independent and 

P(g{[mB,{m + l)B -I]) is quasi- strongly connected^ > (7, m = 0, 1, . . . . 

(ii) We call {Qk}^^ stochastically infinitely quasi- strongly connected, if there exist a (determinis- 
tic) sequence = Co < • • • < Cm < ■ ■ ■ and a constant < g < 1 such that {^/([Cm, Cm+i))}^^^ 
is connectivity-independent and 

P^^([Cm, Cm+i)) is quasi- strongly connected^ > q, m = 0,1, . . . . 

Next, in Subsection 3.1, we study stochastically uniformly jointly quasi-strongly connected 
graph processes, and the proof of Theorem [3] is obtained as a special case. Then in Subsec- 
tions 3.2 and 3.3, two special cases, bidirectional and acyclic graph processes, are investigated, 
respectively. 

3.1 Bounded Joint Connections 

The following result is for consensus convergence on stochastically uniformly quasi-strongly 
connected graphs. 

Proposition 1 Suppose {Gk}'o' is stochastically uniformly quasi-strongly connected with B > 1 
and q > 0. Then ^^ achieves global a.s. consensus if^'^oPs = 00, where 

n-l 

Ps= inf {TJPc,,: aje[s{n-lfB,{s + l){n-l)''B),j = l,...,n-l}. 

1=1 

Moreover, we have 

rcom(e) < inf [m : log (l - ^"^"^^^^^ • > loge-^} x (n - ifB, 

i=0 
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where r] is the constant defined in the weights rule. 

In order to prove Proposition [H we first establish a lemma characterizing a useful property 
of stochastically uniformly jointly quasi-strongly connected graphs. 

Lemma 3 Assume that is stochastically uniformly quasi-strongly connected. Then for any 
s = 0, 1, . . . , we have 

P(^3io G V and n < • • • < r„„i e [s{n - if, {s + l)(n - l)^) 

s.t. io is a center of Q{[TjB, (r,- + l)B - 1]) for all j = 1, . . . , n - l) > g^""^)'. 

Proof. Since is stochastically uniformly quasi-strongly connected, the probability that each 
graph Q{jTB, (r + 1)B — 1]) for r = s{n — 1)^, . . . , (s + l)(n — 1)^ — 1, has a center is no less 
than g^"""*^)^. We count a time whenever there is a center node in Q{^tB,{t + 1)B — 1]) for 
r = s(n — 1)^, . . . , (s + l)(n — 1)^ — 1. These (n — 1)^ graphs will lead to at least {n — if counts. 
However, the total number of the nodes is n. Thus, at least one node is counted more than 
(n — 2) times. The conclusion follows. □. 
We are now ready to prove Proposition [TJ 

Proof of Proposition Denote A;^ = s{n — ifB for s > 0. Let io be the center node defined in 
LemmaOsuch that the probability that io is a center oiQ(\TjB,{Tj + l)B — lfj for j = l,...,n — 1 
with kg < TjB < kg+i — 1 is no less than q^"'~^^^ . Assume that 

X^,{ks)<h{ks) + ^H{ks). (16) 

We divide the rest of the proof into four steps. 

Step 1. In this step, we bound Xj(,(A;). With the weights rule of the standing assumption, we have 

^ ^ 0'i(ij{ks)Xj(ks) — ^iQio{ks)XiQ(ks) ~\~ ^ ^ O'iojiks)^ j(kg) 

< ai^^-n^{ks){]^h{ks) + ^H{ks)) + (l - aioio{ks))H{ks) 
<^h{ks)+{l-'^)H{ks). (17) 

Thus, since r/ < 1, no matter node takes averaging or sticks to its current state, we obtain 

Xioiks + 1) < ^hih) + (1 - ^)H{ks). (18) 
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Continuing we know that for any g = 0,1, . . . , 

x^o [ks + q)< Yh{ks) + (1 - y (19) 

Step 2. Conditioned that io is a center of Q(^[tiB, (ti + 1)B — 1]), there will be ii € V, different 
fromio, and a time instance ki € [tiB, {ti + 1)B — 1], such that {io,ii) G Sf,^. Suppose /ci = 
In this step, we bound Xi^{k). 

If ii takes an averaging update at time step ki, with (fT9]) . we have 



{ks + {ks + ?) + ^ flji j (/^s + <i)xj {ks + ?) 
ieMi(fes+';)\{«o} 

< 7^[^h{ks) + (1 - + (1 - 7^)H{ks) 

= '^h{ks) + {l-'^)H{ks), (20) 
which leads to that for any g = {ti + 1)B — ks, ■ ■ ■ , 

x^, {ks + g)< "^Kks) + (1 - "^Wks). (21) 
Therefore, we conclude from (jl9p and (|2ip that 



PUi,(A:,+£)) < -^/i(A:,) + (l-^)/7(A:,), I = 0,1; g > {n + l)B-ks] > g^""^^ min P^. 

Step 3. We proceed the analysis on time interval [T2B, (t2 + 1)B — 1]. Similarly, ^2 / ioiH can 
be found such that 

^{x,^{ks + g) < '^h{ks) + {l-'^)H{ks), l = 0,l,2;g>{T2 + l)B-ks^ 

min P^,P^,. 

ai,a2&[TiB,{T2+l)B~l] 

Repeating on time intervals [tjB, {tj + 1)B — 1] for j = 3, . . . , n — 1, bounds for is, ... , in-i can 
be established as 

P[xi,{ks + g) < '^h{ks) + {l-'^)H{ks), l = 0,...,n-l;g={Tn^i + l)B-ks,...) > P.g^""^)', 
with 

n-l 

Ps= inf {llPa,:a,e[s{n-l)^B,{s + l){n-lfB),j = l,...,n-l}. 



«=1 

Thus, we have 



p(i7(A:,+i) < ^L^h{ks) + (1 - )i/(A:,)) > P.g^""!)', (22) 
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which immediately imphes 



p(nks+i) < (1 - ^^^^mh)) > (23) 



2 

Note that from a symmetric analysis by establishing the lower bound of h(ks+i), it is easy 
to show that ()23p also holds conditioned 

Xi,{ks)>hiks) + ^H{ks). (24) 



Step 4. With ([23]), we have 



(g7?)("-i)' 



which leads to 



B[n{ks+i)] < [^-'-^ Ps)B[n{ks)], (25) 



M-l , N{n-1)2 



E[?^(fcM)] < n (i - ^^'^^2 • ^0^^°) 

s=0 

for all Af > 1 according to the connectivity-independence. Thus, it follows from Lemma [1] that 

lim E[^(fcA/)] =0, (27) 

which yields limfc_5.oo E ['H(A;)] = since ^^(A;) is non- increasing. Using Fatou's Lemma, we further 
obtain 

< EMim n{k)] < lim Blnik)] = 0. (28) 
Therefore, the convergence claim of the conclusion holds because ()28p implies 

P( lim -H(k) = 0) = L 
Applying Markov's Liequality to (j26|) leads to 

Consequently, we have 

Tcom(e) <inf{M: log(l-^^-^^^ P,) > log g-^j x (n - 1)^5. (30) 

The desired conclusion follows. □ 
Suppose Pk+i < Pk for all A;. Then it is not hard to see that X^^q Ps = oo if and only if 
^^=oPk ~^ = oo- Therefore, the following corollary follows immediately from Proposition [TJ 

Corollary 1 Suppose {Qk}"^ is stochastically uniformly quasi- strongly connected and Pfc+i < Pk 
for all k. Then ([1]) achieves global a.s. consensus if ^"^Lq Pk^^ — 

Now we see that Theorem [3] holds as a special case of Corollary [T] with S = 1 in the joint 
connectivity definition. 
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3.2 Bidirectional Connections 

A diagraph Q = (V,<S) is bidirectional if for any two nodes i and j, G £" if and only if 

(j, i) € 8. In this subsection, we study bidirectional graphs. 

Note that we do not impose an upper bound for the length of the intervals [Cm-,Cm+i) 
in the definition of stochastically infinitely quasi-strong connectivity, which makes an essential 
difference from the bounded joint connections. The main result for bidirectional communication 
under stochastically joint connectivity is stated as follows. Note that in this case quasi-strongly 
connected graphs is simplified as connected bidirectional graphs. 

Proposition 2 Suppose P(^fc is bidirectional, k > O) = 1. Assume that {QjS\^ is stochastically 
infinitely connected. Then (1^ achieves global a.s. consensus if^^^Ps = oo, where 

71- 1 

Ps= inf Iri-^^i- ^ [Cs{n-i),C(s+i)(n-i))j = '^,---,n-l\. 

1=1 

and also 

s-l _^ 

reom(e) < inf {C,(„_i) : ^log (l - • P,) > logg-^}. 

i=0 

Proof. We will prove the conclusion by showing P(limfc_>.+oo ^(^) = 0) = 1. Take a node io & V 
with Xio(Co) = h{Co). 

Define ti = inffcx^gjio has at least one neighbor in Q/^} and Vi = {j : j is a neighbor of zq 
at time ti}. Then we have P(ii < Ci) > g because {Gk}o^ is stochastically infinitely connected. 
Noticing that 

Yl ahj{h)xj{ti) = aioig{ti)xio{ti) + ^ aioj{ti)xj{ti) 

< a^o^o(*l)^(Co) + (1 - ai^i,{ti))H{Co) 

<rjh{Co) + {l-v)HiCo). (31) 

we have 

P [xi, (ti + 1) < 7jh{Co) + (1 - v)H{Co)) = 1. (32) 
Similarly, for ii € Vi, we have 

aiij(ti)xj(ti) = aj^io(ti)xjo(ti) + ^ ai^j{ti)xj(ti) 
iGMi(ti) ieMi(ti)\{io} 

< a,,i„(ti)/i(C7o) + (l {ti))HiCo) 

<rih{Co) + {l-v)H{Co), (33) 
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which imphes 

P (x,, (ti + 1) < vKCo) + (1 - 7j)HiCo)) > Pt, . (34) 
Thus, we conclude from ([32]) and that 



P(x/(ti + 1) < TiHCo) + (1 - v)H{Co), I G {io} U Vi) > Plf^l. (35) 

Furthermore, we define t2 = inffc>fcj{at least one other node is connected to {ig} U Vi in 
Gi:} and V2 = {j € V \ {{io} U Vi) : j is connected to {io} U Vi at fc = t2}- Again we have 
P{t2 < C2\ti < Ci) > q. Similar analysis leads to 

P{xi{t2 + 1) < v'^HCo) + (1 - V^)H{Co), I G {io} U Vi U V2) > Pj^'^Pj^'^. (36) 

Continuing the analysis, t^, . . . , and V3, . . . V^^ can be defined until V = {io} U ( Uf=i "^l) 
for some fj,o < n — 1, and eventually 

P(xKt/.o + 1) < v''°HCo) + (1 - V^')H{Co), I G V) > n^r'' (37) 

which yields 



Mo 



P(^(V, + 1) < (1 - ^^'')^(Co)) > • (38) 

/=1 

Therefore, because Ho < n — 1 and P(t/io < C'n_i) > q"'~^, we have 

P(w(a-i) < (1 - v'^-'mCo)) > Poq""-^ (39) 

with Po = inf„j<...<„„_j { nr=i"^ : ^ [Co,C'n-i), j = 1,. • • ,n - l|. 
Bounds for 71(0^(^^-1)) can be similarly obtained for s = 1, 2, . . . as 

p(?^(q,+i)(„_i)) < (1 - ??"-^)?^(c,(„_i))) > p,g"-^ (40) 

Therefore, by the same argument as in the proof of Proposition [TJ global a.s. consensus holds 
and 

Tcom(e) < inf {C,(„„i) : log (l - ((^r/)^"-!) • P.) > loge-'}. (41) 

i=0 

The proof is completed. □ 
The following corollary follows directly from Proposition [21 

Corollary 2 Suppose P[Gk is bidirectional, k > O) = 1 and Pk+i < Pk for all k. Suppose Gk is 
stochastically infinitely connected. Then ^^ achieves global a.s. consensus ifYlT=o^c~(^ 1) ~ 

15 



3.3 Acyclic Connections 

A digraph Q = (V, £) is acyclic if it contains no cycle. This subsection focuses on acyclic com- 
munication. 

Let Q be an acyclic, quasi-strongly connected digraph. Then it is not hard to see that Q has 
one and only one center. Denote this center as vq and let vq — )> j be a path from vq to j in Q. 
Let \vo — )■ j\ represent the length of vq — )• j as the number of arcs in this path. We now define 
a function on Q by h{vo) = and h{j) = max{|uo j\ : vq j is a path in Q} for any j ^ vq. 
Let = maxjgv Then we establish the following lemma indicating that this function h is 
surjective from V to {0, ... , d*}. 

Lemma 4 Let Q he an acyclic, quasi-strongly connected digraph. Then h~^{m) = {i : h{i) = m} 
is nonempty for any m = 0, . . . , . 

Proof. The conclusion holds for m = trivially. 

Let us prove the conclusion for m = 1 by contradiction. Assume that h~^{l) = 0. Then 
we have niQ = infi^i,^ h{i) > 1. Take a node jo with /i(jo) = tuq. There exists a (simple) path 
^0 ~^ jo in G with length niQ > 1. Let be the node for which arc (v*,Jo) is included in 
Vq — > jo- According to the definition of mo, we have > mo. Suppose vo — )■ is a path 

with length h{v^). Note that, jo cannot be included in vo because then it would generate 

a cycle jo — > f * ^ jo- Consequently, another path — > t'* ^ jo is obtained whose length is 
h{v^) + 1 > mo. This contradicts the selection rule of jo. Therefore, the conclusion holds for 
m = 1. 

Next, we construct another graph Q from Q by viewing node set {fo} U h~^{l) as a single 
node in the new graph without changing the arcs. We see that h~^{2) of Q is exactly the same 
as the node set h~^{\) of Q, while the latter is nonempty via previous analysis. Continuing the 
argument, the conclusion follows. □ 

Here comes our main result for acyclic graphs. 

Proposition 3 Assume that P(^([0, oo)) is acyclic) = 1 and {Gk}o^ is stochastically infinitely 
quasi-strongly connected. Then ^ achieves global a.s. consensus if^^=o^s = oo, where Pg = 
infc,<a<c,+i Pa, s = 0, 1, . . . . 

Proof. Let vo be the unique center node of ^([0, oo)). Based on Lemma |H Vj = h~^{i) for 
i = 0, . . . , ho can be defined with Vq = {^^o} and V = (Jj-^o "^i- 
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Obviously we have P[xyQ{k) = Xy^j{0),k > O) = 1 because with probabihty one, vq has no 
neighbor except itself for all k. We turn to Vi. 

Claim. P^linifc^oo \xi{k) — j;^q(0)| = 0^ = 1 for all / G Vi. 

Take vi G Vi. With probability one, vq is the only neighbor of vi excluding itself in Qk for 
all k. Define ti = inffc>o{('Uo, t'l) € £k}- Then P(ti < Ci) > q. We have 

= (l - ay-,vo{h))\xvA^) - Xvo{^)\ 

< (l-r/)|x,,(0) -x„o(0)|, (42) 

which yields 

V(\xy^{ti + l)-xy^{{))\ < (l-7?)|x„,(0)-x^o(0)|) >Pt,. (43) 

Thus, we obtain 

p(|x,JCi)-x„„(0)| < {1 - i])\x,,{0) - x,,{0)\) >Poq, (44) 



where Pq = iTi{co<a<Ci Pa- Repeating the analysis on time interval [Cm, Cm+i), m = 1, 2, . . . , 
we have 

p(|x„,(C™+i)-x^o(0)| < (l-r?)|x^,(C^)-x„o(0)|) >Pmq, m = l,2,.... (45) 

Similar to the proof of Proposition [2l connectivity independence leads to P(limfc_^oo \xv^{k) — 
Xvo{0)\ = O) = 1. The claim is proved. 

Further, we turn to V2 and prove P( limfc^oo |a^/(^) — Xyg{0)\ = O) = 1, / G V2. Take 
e = 1/i for some i > 1. The previous claim implies that there exists T{i) > such that 
P(|x/(A;) — Xt,,j(0)| < l/£,k > T,l G Vi) = 1. Suppose Czj > T for some integer zi. Let V2 be an 
arbitrary node in V2- We next show P ( lim sup^j^g^ \xv2 

[k) - 2;„,(0)| <l/i) = 1. There will be 

two cases. 

(i) If there exists <;o > such that |x„2(?o) — 2;t,„(0)| < 1/^, it holds that |x„2(A:) — x„o(0)| <l/l 
for all k > Thus, denoting E = ^\xy.^{k) — x.u„(0)| > l/£ for all /c > O} as an event, we 
have P(limsupfc_^^ \xy,{k) - Xy„{0)\ < 1/£|E^) = 1. 

(ii) With probability one, all the neighbors of vi excluding itself in Qi^. are within {vq} U Vi for 
all k, i.e., P{{^^^,2{k) C {v2}U{^o}UVi, A: = 0,1,...) = 1. Define h = inffc>c, Jthere is 
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at least one arc leaving from {"^0} U "^'i entering V2 in Sf.}. Then we obtain 



je{vo}uVi 

< [1 — a^^ii^i^i)] 7 "I" '^t'2f2(^i)|'^f2(^n) ~ ■^t'oC'-')! 



(46) 



which yields 



1 



I J2 ay2j{h)xj{ti) - Xy„{0) 
Consequently, denoting = \xv2iCm) — XvoiO)\ — 1/^ for m = 0, 1, . . . , (f^7|) leads to 



(47) 



and similarly 



P Vm+l <1Tyni] > Pmq, m = Zi + 1, . 



(48) 



(49) 



When X^^o ~ based on the same argument as in the proof of Proposition [H we 
see from ()39]l that lim^.^oo ^{Um) = 0, and therefore 



P( limsup Ixy^ik) — Xi,g{0)\ < 1/i 

^ fc— >-CXD 



E = 1. 



(50) 



As a result, we obtain P ^ lim sup;j_^oj3 {x^^lk) — Xi,^j{0)\ < l/£j = 1. Since £ is chosen arbi- 
trarily, we further conclude that 



P( lim \xi{k) - x„o(0)| = O) = 1, / G V2. 

\ fc— >-oo / 



Therefore, continuing the estimations on node set V3, . . . , Vd, , eventually we have P( limfc_j.oo 
\xi{k) — Xi,[,(0)| = 0) = 1 for all / € V. The desired conclusion thus follows. □ 
Proposition [3] leads to the following corollary. 

Corollary 3 Assume that P(Cy([0,oo)) is acyclicj = 1. 

(i) Suppose {Qk}o^ is stochastically infinitely quasi- strongly connected and Pk+i < Pk for all 
k. Then (OP achieves global a.s. consensus if'^m=0'^Cm — 

(a) Suppose {Gk}'o' is stochastically uniformly quasi- strongly connected. Let either B = 1 or 
Pk+i ^ Pk; k >0 hold. Then ^^ achieves global a.s. consensus if and only if^'k=oPk — 
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4 Arc-independent Graphs 

In this section, we consider arc-independent graphs and prove Theorem HI We present the con- 
vergence analysis using a stochastic matrix argument. 

Let Cj = (0 . . . 1 . . . 0)"^ be the n x 1 unit vector with the ith. component equal to 1. Denote 
ai{k) = {an . . . CLinY' as an n x 1 unit vector with aij{k) = aij{k) if j G Mi{k), and aij{k) = 
otherwise. Let W{k) = {wi{k) . . . Wn{k))'^ £ R"^"' be a random matrix with 

{ai{k), with probability Pk 
(51) 
ej, with probability 1 — P^ 

for i = 1, . . . , n. Algorithm ([TJ is in a compact form: 

x{k + l) = W{k)x{k). (52) 

We first establish several useful lemmas on the product of stochastic matrices, and then the 
proof for Theorem [3] is presented. 

4.1 Stochastic Matrices 

A finite square matrix M = {rriij} S R"^" is called stochastic if rriij > for all i,j and 
~ ^'-'^ ^ stochastic matrix M, introduce 

6{M) = maxmax \maj — m^j\, A(M) = 1 — min > min{mQ,j, m^,}. (53) 

j a,/3 a, 13 ^ — ' 

j 

If A(Af) < 1 we call M a scrambling matrix. The following lemma can be found in [16]. 

Lemma 5 For any k (k > 1) stochastic matrices Mi, . . . , Mk, 

k 

5{MiM2...Mk)<J{\{Mi). (54) 

i=l 

Let M = [mij] G R"^" be a matrix with nonnegative entries. We can associate a unique 
digraph Qm = {V, £m} with M on node set V = {1, ... , n} such that (j, i) € £m if and only if 
ruij > 0. We call Qm the induced graph of M. 

The following lemma is given on the induced graphs of products of stochastic matrices. 

Lemma 6 Let Mi, . . . , be k > 1 stochastic matrices with positive diagonal entries. Then 
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Proof. We prove the case k = 2, and the conclusion wiU then follow by induction. 

Denote Aij^^\ Mj;f and M^f"^^ as the ij-entries of Mi, M2 and M2M1, respectively. Note 
that, we have 

n 



m=l 



The desired conclusion follows immediately from M^f' ,m'^'^^ > 0. □ 
The following lemma helps in determine whether a product of stochastic matrices is a scram- 
bling matrix. 

Lemma 7 Let Mi, . . . , M„_i ben — 1 stochastic matrices with positive diagonal entries. Suppose 
there exists a node zq G V such that io is a root of Qm^ for all t = 1, . . . ,n — l. Then M„_i • • • Mi 
is a scrambling matrix. 

(s) 

Proof. We denote the zj-entry of Mg as for s = 1, . . . , n — 1. Since io is a center of Gmi, 

at least one node ii exists different with vq such that {io,ii) S £mi- This immediately implies 
^hio ^ ^ according to the definition of induced graph. 

Further, we denote the ij-entry of M2M1 as M^j'^^^\ According to Lemma [6l we have 
M-'^]^^'^ > resulting from M^^} > 0. Since in is also a center of Gau, there must be a node i2 
different with io and ii such that there is at least one arc leaving from {io,ii} entering i2 in 
Gm2- There will be two cases. 

(i) When (io,i2) £ ^Ah^ we have Mj^^j^ > 0, which implies Alj^^^^^^'^ > based on Lemma [H 

/2\ 

(ii) When (ii,i2) £ ^Ah^ we have M-^J^ > 0. Thus, we obtain 

n 

M,<f ^> = y M^Im^';^ > Mfl > 0. (56) 

T=l 

Similar analysis gives is, ... , in-i such that V = {io, • • • , in-i}- We eventually obtain 

^{n-i)...(i> ^ Q TO = 0, 1, . . . , n - 1 (57) 

where M-^j^"^'"^^^ denotes the ij-entry of M^-i ■ ■ ■ Mi. 

According to the definition of 5(M) in ()53p . ()57p implies 

A(M„_i • • • Ml) < 1 - min M^^-^^ < I. 

m=0,...,n.— 1 " 

The desired conclusion follows. □ 
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4.2 Proof of Theorem m Convergence 

This subsection presents the proof of the conclusion on a.s. consensus in Theorem HI We only 
need to show the sufficiency part. Note that global a.s. consensus of ([1]) is equivalent with 

Pf lim 5(W{k) ■ ■ ■ W(0)) = o) = 1, 

where 5{M) of a stochastic matrix M is defined in ()53p . 

Node i succeeds at time k if it follows the averaging dynamics at time k, i.e., if Xi{k + 1) = 
SjeM(fc) aij{k)xj{k). We define 



1, if at least one node succeeds at time k: 

(58) 

0, otherwise. 



Then, we have ^'^ = 1 with probability 1 — (1 — Pfc)" and = with probability (1 — Pk)"'- 
Moreover, ^i) • • • are independent. The following lemma is given on ^'/j. 

Lemma 8 P{^k = 1 for infinitely many k) =1 if and only if Xlfc^o -^'^ ~ 

Proof. Assume that ^^^^Pk < oo. Lemma [T] implies that nfc^o(^ ~ ^k) > 0, which yields 
nfcLo(l ~ Pk)" > 0- Therefore, we have P(^'fc = 0, A; = 0, . . . ) > 0. The necessity claim holds. 

On the other hand, suppose YlT=QPk = co. Then Lemma [1] leads to Hfc^Tll ~ ^fc)" = for 
ah T > 0. Thus, 

oo oo 

v(^^k = l for finitely many /c) = v(^T > 0, i.e., = for aU > P) < J2 11^^ ~ ^^'>'' = °- 

T=Ok=T 

The sufficiency part therefore follows. □ 
Noting the fact that 

l-ny<{l- y)" 

for all y G [0, 1] and n > 1, we obtain 

1 - (1 - Pk)" <nPk, k = 0,.... 

Thus, we have 

P ( node i succeeds at time k 



^k = i) = ^ p,n >^ = - (59) 

1 - (1 - Pfc) nPk n 



for all i and k. 



21 



Based on Lemma [8l with probability one, we can well define the (Bernoulli) sequence of 



1 oo 
10 ' 



Cl < . . . < Cm < Cm+1 < • • • , (60) 

where Cm is the m'th time when = 1- Then according to (|59p . for any (i,j) € S*, we have 
P((^,j) e QwiCm)) = PO' succeeds at time Cm) • P((«, j) G ^Cm) > — (61) 



for 771 = 1, 2, ... . 

Denote Qi = W^(C|£*|) • • • W^(C2)^(Ci)) where \£*\ represents the number of elements in S* . 
From ([UT]). we can pick up {ir^jr), r = 1, . . . , If* | as all the arcs in £*, and the arc-independence 
leads to 

\£* I 

P({ir,jr)(^gwi(;r), r = 1,..., ]£*()> (^) , (62) 



n 



which yields 

If* 



P(r C Qq^) > P(r C ( U (?^(^^))) > (^)"*' (63) 

T=l 

according to Lemma [6l 

We continue defining Qm = ^(Cm|£:*|) ' ' ' ^(C(m-i)|£:*|+i) for m = 2, 3, . . . , and similarly 

P(e-ceg„.)>(^)"'' (64) 

for all m. Because G* is quasi-strongly connected, Lemma [7] yields 

p(a(Q„_i---Qi) <l) > (^) '. (65) 

Moreover, since Qn-i ■ ■ ■ Qi represents a product of (n — 1)|£'*| stochastic matrices, each of which 
satisfies the weights rule. Therefore, each nonzero entry, Qij of Qn-i ■ ■ ■ Qi, satisfies 

Q,,- >r?("-i)l^*l. (66) 

We see from ([55]) and that 

p(A(Q„_....a)<l-'>"'-"^-)>(^)'""""' (67) 
Denoting Um = Qm{n~i) " " " Q(m-i)(n-i)+i for m = 1 , 2, . . . , we can now further conclude 

(n-l)|£-*| 



P(A(f/„)<l-,("-)l^*l)>(^ 
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for all m = 1, 2, . . . . 

Thus, based on Lemma [5l we have 



hm E 

m— >oo 



T=l 



'5{Ura---Ui) \ < lim E[fTA(C/^)l =0, (69) 
Then from Fatou's Lemma we have 

Pf lim^(f/^---C/i) =0) = 1, (70) 

which leads to 



m—^oo 



P(^^hm 6{W{k)---W{0)) = Oj = 1 

since W{k) = In for any k ^ {(^1,(^2, ■■ where /„ is the identity matrix. Hence, we have 
obtained global a.s. consensus for ([1]). 

4.3 Proof of Theorem [4t Computation Time 

In this subsection, we establish the upper bound of Tcom(e) given in Theorem HI 
Denote the ij-entry of W{k — 1) . . . VF(0) as ^ij. Then for all i,j and r, we have 



(/c) - Xj{k)\ = I ^iaXa{0) - ^jaXa{0)\ 
a=l a=l 

n n 

a=l a=l 

n 

< / I'^ia — '^jal • max |xa(0) — 2;t-(0)| 



Q = l 



< n5{W{k -!)••• W{id)) ■ max |x„(0) - x^(0) | . (71) 
Therefore, we obtain that for all /c > 1, 

-Hik) <n5{W{k-l)---W{Q))U{{)). (72) 
Introduce a sequence of random variables 

fc-i 

= max {?n : Cm < A; - 1} = ^ ^i, /c = 0, 1, . . . 
where Cm is the Bernoulli sequence of {*I'A:}(f defined in ([60]) . 
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Denote Eq = {n — Then according to Lemma [5] and applying Markov's Inequality, 

2]) implies 

nik) 



no) 



> e) < F[6{W{k -!)••• T^(0)) > 



< -E 

e 

n. 



6{W{k -l)---W{0)) 



< E[A^ •••Ai], 



(73) 



where Eq = (n — 1)|£'*| and by definition Am = ^{Um) for m = 1,2,... and \_z\ represents the 
largest integer no greater than z. 

It is not hard to see from (1651) that 



E[A™] <l-(^)^°, m = l,2,.... 



which yields 



E 



\,^....Xi 



E 



E[A, . . . Ail^fc] 



< 1 



n 



since the node dynamics is independent with the graph process. 
Therefore, with (|73p and (j75p . we have 



P(^>.)<-(1 



(74) 



(75) 



(76) 



so ([5|) can be obtained immediately by some simple algebra. 



5 Conclusions 

This paper investigated standard consensus algorithms coupled with randomized individual node 
decision-making over stochastically time-varying graphs. Each node determined its update by 
a sequence of Bernoulli trials with time-varying probabilities. The central aim of this work 
was to investigate the relation between the required level of independence of the graph process 
and the overall convergence. We consequently introduced connectivity-independence and arc- 
independence for graph processes. An impossibility theorem showed that a.s. consensus can 
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not be achieved unless the sum of the success probabihty sequence diverges. Then a series of 
sufficiency conditions were given for the network to reach a global a.s. consensus under various 
connectivity assumptions. 

Particularly, when either the graph is arc-independent or acyclic, the sum of the success 
probability sequence diverging is a sharp threshold condition for consensus under a simple self- 
confidence assumption. In other words, consensus appears suddenly as the sum of the probability 
sequence goes to infinity. Consistent with classical random graph theory, this so-called zero-one 
law was to the best of our knowledge first established in this paper for distributed consensus 
computation over random graphs. 
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